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We  give  three  globally  convergent  iteration  schemes  for  finding  zeros  of 
maximal  monotone  operators  in  Hilbert  spaces.  We  assume  that  the  operators  are 
defined  in  the  whole  space  and  are  either  continuous,  grow  at  most  linearly  at 
infinity  or  map  bounded  sets  into  bounded  sets.  As  applications  we  have  globally 
convergent  iteration  schemes  for  minimizing  convex  functionals  in  Hilbert  spaces. 
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SIGNIFICANCE  AND  EXPLANATION 

One  of  the  main  problems  in  numerical  mathematics  is  to  construct  solutions 
to  equations  f(x)  =0.  It  is  important  to  know  whether  solutions  can  be  found 
by  iteration,  i.e.  using  only  a countable  number  of  evaluations  of  f.  In  this 
paper  we  give  convergent  iteration  schemes  for  operators  which  in  a mathematical 
sense  form  a well  defined  general  class,  including,  e.g.,  minimization  of  convex 
functionals.  Although  in  many  practical  cases  the  convex  functional  would  have 
some  additional  properties  which  imply  that  the  usual  gradient  method  would  con- 
verge, we  do  not  know  of  any  previous  iterative  algorithms  which  would  always 
converge  for  the  general  class  of  functionals  considered  here. 

Our  schemes  all  have  the  following  important  properties:  only  qualitative 
assumptions  on  the  operators  are  made,  one  does  not  have  to  know  whether  solutions 
exist,  and  the  schemes  work  independently  of  the  initial  guess.  On  the  other 
hand,  demanding  all  these  properties  implies  that  the  convergence  may  be  very 
slow. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive  summary 
lies  with  MRC,  and  not  with  the  author  of  this  re wt.  ^ rv 

' ■'  n 9 ' ’I  t)o  # 


GLOBAL  ITERATION  SCHEMES  FOR  MONOTONE  OPERATORS 


Olavi  Nevanlinna 


1 . 1 ntrcxluction. 

In  this  paper  we  consider  iteration  schemes  to  find  zeros  of  monotone  operators  in 
Hilbert  spaces.  Let  H be  a real  Hilbert  space.  A possibly  multivalued  operator  A is 
said  to  be  monotone  if 


(1.1) 


Xj^  - Xj)  i 0 for  all  x^  r D(A)  and  < Ax^^ 


A is  maximal  monotone  if  it  is  monotone  and  there  does  not  exist  any  monotone  proper  exten- 
sion of  A.  Examples  of  maximal  monotone  operators  are  subdifferentials  ^ of  proper  con- 
vex lower  semicontinuous  functionals  'f , and  finding  solution  of  ix)  * 0 is  equivalent 
to  minimizing  . 

We  shall  show,  using  ideas  of  Bruck  13)  and  Crandall  and  Pazy  14] , that  if  A is  defined 

in  the  whole  space  and  is  either  continuous  or  grows  only  linearly  at  infinity,  then  we  can 

find  seoueiices  {X  ),  {0  } such  that  if 
n n 


(1.2) 


n+1 


- X (Ax  + 6 X ) 
n n n n 


I 


then  x^  converges  strongly  to  a solution  of  Ax  s 0,  if  there  exists  any,  otherwise  it 
tends  to  infinity.  In  particular,  we  can  find  the  minimum  of  any  lower  semicontinuous  convex 
functional  which  is  either  continuously  differentiable  or  grows  only  quadratically  at  infinity. 

Assume  for  a while  that  A is  strongly  monotone,  i.e.  it  is  of  the  form  bl  + B,  where 
b > 0,  I is  the  identity  operator  and  B is  maximal  monotone.  Then  R(bl  + B)  = H and 
bx  + Bx  JO  has  a unique  solution.  Any  strictly  contractive  mapping  T:H  -►  H, 

|tx  -Tyl^k|x-y|,k<l,  gives  an  example  of  such  operators  by  defining  A » I - T 
(•  (l-k)I  + (kl-T)),  jmd  the  zero  of  A,  or  the  fixed  point  of  T,  can  be  obtained  by 
Picard-Lindelof  Iteration 


(1.3) 


n+1 


Tx 

n 
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If  H is  I.ipschitz-continuous  thnn  wo  can  still  itorato  in  the  form 


(1.4) 


K , = X - A ( Bx  ♦ bx  ) , 

n+1  n n n 


provided  A is  small  enough,  and  this  was  used  by  Zarantonello  (8)  to  prove  the  existence 
of  a zero  for  those  operators.  Lipschitz-continuity  can  be  wealiened,  in  a natural  way,  into 
two  directions:  assuming  that  the  operator  satisfies  a linear  growth  condition  or  assuming 
only  continuity.  In  both  cases  the  zero  can  be  found  by  iteration  in  the  form 

(1.5)  X t X - A (Bx  + bx  ) , 

n+1  n n n n 

where  {A  ) is  a sequence  of  possitive  numbers.  BrucJc  (2)  considered  (1.5)  with  A 


n cn+o 

for  operators  which  have  open  domains,  but  his  result  is  then  local  in  the  sense  that  conver- 
gence is  guaranteed  only  when  the  Initial  value  is  chosen  close  enough  to  the  solution.  In 
section  4 we  state  a global  version  of  this  result  by  assuming  that  A satisfies  a linear 
growth  condition. 

Continuous  monotone  operators  are  maximal  and  therefore  bx  + Bx  = 0 has  a solution. 

In  (41  Crandall  and  Pazy  gave  a constructive  proof  for  the  existence  of  a solution  in  general 
Banach  spaces.  It  uses  iteration  of  the  form  (1.5)  where  A^  is  decided  at  each  step  using 
a finite  number  of  evaluations  of  Ax. 

If  the  operator  is  not  strongly  monotone  schemes  of  the  form 


(1.6) 


X . , f X - A Ax 
n+1  n n n 


can  still  be  used  if  the  operator  satisfies  a convergence  condition  (6),  but  without  some 
additional  properties,  even  when  A is  the  gradient  of  a convex  functional,  we  generally  do 
not  have  strong  convergence.  To  obtain  strong  convergence  in  such  a case  we  use  the  method 
of  regularization:  we  apply  the  scheme  (1.6)  to  operators  A + 8^1  and  let  0^  tend  to  zero 
as  n ♦ “■.  The  problem  is  to  define  *8^  ^®n^  * balanced  way  that  strong  con- 

vergence to  a correct  solution  is  obtained.  Here  we  use  ideas  that  go  back  to  Bruck  [3]  and 
Halpern  (5). 

We  also  show  that  if  A is  defined  in  the  whole  space  and  is  bounded,  then  we  can  always 
define  a convergent  scheme  of  the  form  (1.2),  which  uses  a finite  number  of  reinitializations. 


> 


2. 


R<*su  Its . 


Let  A be  a maximal  monotone  operator  in  a Hilbert  space  H.  In  our  first  result  A 
is  asstiined  to  be  continuous  and  in  the  second  A satisfies  a growth  condition  of  the  form 

(2.1)  lylllC(l+]x|),  forall  x,  and  y ' Ax 

Finally,  in  the  third  result  we  assume  that  A maps  bounded  sets  into  bounded  sets. 

The  algorithms  can  be  applied  without  knowing  whether  there  exists  solutions  cr  not,  and  we 
do  not  assume  anything  on  the  modulus  of  continuity,  nor  one  has  to  know  the  value  of  the  con- 
stant C in  (2.1). 

We  state  the  result  first  for  continuous  operators.  Let  ^ decreasing  sequence 

of  reals  such  that  lim  h - 0,  and  let  fr  } be  a decreasing  sequence  satisfying 
n-H» 
r 

lim  r - 0,  lim = 1.  Choose  a decreasing  function  ii<(s)  satisfying 

n x»  n ^ n+1 

txt 

(2.2)  /i()(s)ds<'», 

0 

and  such  that  for  all  > 0 there  exists  6(t,S|j)  so  that 


{X  ),  {6  } are  defined  recursively  as  above  by  (2.4)  and  (2.5).  If  A ^0  0,  then  x 

n n n 

converges  strongly  to  p,  where  p is  the  element  in  A ^0  with  minimum  norm,  and  if 

A ^0  = (?,  then  1 x 1 as  n -*■  ” in  such  a way  that  6 x converges  to  -a'^  where  a*^ 

' n ' n n 


is  the  element  in  R(A)  with  minimum  norm. 


Q 


The  proof  is  postponed  to  section  3. 

If  instead  of  continuity  we  assume  that  A satisfies  a growth  condition  of  the  form 

(2.1)  then  the  sequences  {X  },  {0  } can  be  chosen  independently  of  the  operator  A.  The 

n n 

following  definition  is  essentially  as  in  [3] : 

Definition.  Two  sequences  positive  real  numbers  are  acceptably  paired  if 

(9  } is  nonincreasing,  lim  6 =0,  and  there  exists  an  increasing  seouence  {n(i)}  of  in- 

n n 

n-w» 


tegers  such  that 


(2.6) 


n(i+l)-l 


lim  inf  0 , . . . 

n(i)  . 1 

n-«»  j=n(i) 


1 K ’ 0 

i(i) 

n(i+l)-l 


(2.7) 


(2.8) 


I ^ < 


lim  sup  0 , . . , ... 

n(i)  . S,,  j 

n-«<>  j=n(i) 

n(i+l)-l 

lim  (0  ,,,  - 0 ,.,,,)  J X , = 0 . 

i-  n(i)  n(i+l)  j 


Part  of  the  proof  of  Theorem  1 consists  of  showing  that  the  recursive  procedure  (2.4),  (2.5) 

always  generates  acceptably  paired  sequences.  Another  example  of  acceptably  paired  sequences 

is  the  following  (3]:  X » n 9 - (log  log  n)  n(i)  - i^  . 

n n 

Theorem  2.  Let  A be  a maximal  monotone  operator  in  a Hilbert  space  and  assume  that  it 

is  defined  in  the  whole  space  emd  satisfies  the  growth  condition  (2.1)  for  some  C < 

2 

Assume  that  (X  } c t and  that  (X  },  (0  } are  acceptably  paired.  If  (x  } satisfies 
n n n c-  j r- 

(1.2)  with  any  initial  value  x^  £ H,  then  the  conclusion  of  Theorem  1 holds. 

D 

The  proof  of  this  result  is  given  in  section  4. 

Assume  now  that  A is  defined  in  the  whole  apace  and  is  only  bounded,  i.e.  it  maps 
bounded  sets  into  bounded  sets,  vte  give  an  iteration  scheme  which  uses  reinitialisation  if 


-4- 


1 


X tends  to  be  too  big. 
n 

Consider  the  scheme 


(2.9) 

x^  1 f. 
n+1 

x^  - Y X (Ax^  + 
n p n n 

0 x*^)  , x^  = 
n n 0 

*0  ' 

where 

is  any 

decreasing  sequence  such  that 

O 

lim  Y = 0, 

, emd 

(X  }, 

n 

, {0  } 
n 

paired 

and  ^ 

t . Choose 

an  increasing  sequence  {R  } 

such 

that 

lim  R 

y-Hio  ' 

r U y 

Now  compute  { x } 
n 

for  a fixed 

W using  (2.9) , 

as  long  as 

*ol  ^ 

R . 

P 

^ then  start  computing  the  sequence  }, 

u 

Theorem  3.  Let  A be  a bounded  incutimal  monotone  operator,  euid  assume  that  lx  ) is 
n 

obtained  using  the  procedure  described  above.  If  A ^0  / 0,  then,  for  some  - x^l  ^ 

for  all  n,  and  tends  to  the  minimum  element  in  A ^0;  otherwise  A ^0  = 0 and  w 

n 


tends  to  infinity. 


□ 


t 


Proof.  We  observe  first  that  if  A 0 = ► U tends  to  infinity.  In  fact,  otherwise 

for  some  fixed  u,  {x*^}  c B„  (x_)  for  all  n,  where  B <z)  denotes  the  closed  ball  of 
n R 0 s 

M 

radius  s,  centered  at  z.  But  then  A,  operating  only  in  B (x  ) can  be  thought  of  as 

R 0 

“ -1  w 

satisfying  the  growth  condition  (2.1)  and,  bv  Theorem  2,  we  would  have  A 0 f 0 and  x^ 
converging  to  the  minimum  element  in  A ^0.  Therefore,  the  only  thing  we  have  to  prove  is, 
that  if  A ^0  0 then  u cannot  tend  to  infinity. 

Consider  the  scheme 


(2.10) 


X e X - rX  (Ax  + 6 X ) , 

n+1  n n n n n 


where  v > 0 and  (X  },  {0  } eure  as  in  (2.9).  A theorem  of  Bruc)c  [3,  Theorem  3)  includes 
n n 

the  following  result:  If  y c A ^0  and  for  some  r ^ |yl,  e B^(y)  and  A is  defined 

* * 

and  bounded  in  (y) , then  there  exists  a y ’ > 0 such  that  if  Y “ Y < then  x stays 

2r  n 

in  converges  to  the  minimum  element  in  A ^0.  It  is  evident  from  the  proof  of 

« 

this  result  that  the  same  conclusion  actually  holds  for  all  y r (0>Y  )• 

If  A ^0  0,  let  r « max{|y|,  Ixg-y]},  for  some  y t A ^0.  Then,  as  \t  grows,  there 

* 

is  a such  that  y < y and  R > 3r,  so  that  we  must  have 

° “o  - “o  - 


-5- 


{x  c B (y)  c B (x„)  for  some  p < p„.  and  the  proof  is  con5>lete. 

n R 0 max  — 0 

^0 

□ 

Continuous  monotone  operators  are  maximal,  but  in  the  situations  discussed  by  Theorems 
2 and  3 it  may  happen  that  we  do  not  know  the  meutimality  of  the  operator.  However,  even  if 

the  operator  is  not  maximal,  the  schemes  eu:e  well  defined  and  the  conclusions  hold,  with  the  , 

modification  that  the  convergence  takes  place  exactly  when  there  exists  a monotone  extension 
A of  the  operator  A such  that  A ^0  0. 

i 

I 

1 


I 

i 

I 

i- 

\ 

L 

i = 


3.  Proof  of  Tficorr!ni  1. 


The  proof  consists  formally  of  two  parts.  Denote  by  p^  the  unique  vector  such  that 

(3.1)  Op  + Ap  - 0 . 

n n n 

We  shfjw  that  the  sequence  {x  ) qencrated  by  (1.2),  (2.4),  (2.5)  behaves  for  large  n as 

n 

(p^l,  and,  in  fact  this  is  true  in  any  Banach  space  for  continuous  accretive  ofxirators. 

However,  in  general  A ^0  ^ 0 does  not  imply  that  converges.  In  Hilbert  spaces  this 

always  happens  and  in  particular  the  convergence  of  follows. 

Let  J,  « (I  + AA)  so  that  p = J , 0.  Now  the  behavior  of  p follows  from  the 

A n X n 

0 

n 

following  result. 

Lemma.  Let  A be  any  maximal  monotone  operator  in  a Hilbert  space.  Then 

(3.2)  lim  i J^O  = -a°  , 

X POO 

where  is  the  element  in  R(A)  with  minimum  norm.  If  A ^0  * 0 then 

X ■*  and  if  A ^0  / 0,  then  J^O  ► p as  A ► » where  p is  the  element  in  A ^0  with 
minimum  norm. 


Proof.  Let  denote  the  Yosida  approximation  of  a maximal  monotone  ojjerator  B: 

* t ^(T  - (B)  ) , where  “(If  tB)  One  verifies  easily  that  J^(B)0  * (B  0. 

t 

Now  J^(B)0  tends  to  the  minimum  element  in  D(B)  as  t ♦ 0 (1,  Theorem  2.21.  Therefore 

(B  ^ 0 tends  to  the  minimum  clement  in  D(B)  as  t * 0.  For  B ^ * A this  means  that 

t 

lim  A^O  « a^,  and  (3.2)  follows  since  — J^O  “ also  know  [1,  Proposition  2.6)  that 

t-»« 

B^O  tends  to  the  minimum  element  in  BO  as  t -►  0 if  0 c D(B)  , otherwise  * ”• 

Using  this  for  (A  ^1^^  0 with  t *■  * yields  the  rest  of  the  Lemma. 


We  consider  first  the  following  implicit  iteration  scheme 


X . + A (Ax  ^ ^ ® 

n+1  n n+1  n n+1  n n 


-7- 


IV«|i  ijfr'! 


Proposition  1.  Let  A be  maximal  monotone  and  be  acceptably  paired.  Assume 

OQ 

that  {x  } satisfies  (3.3)  so  that  I |e^l  < «.  If  a“^0  ¥ 9,  then  converges  to  the 

minimum  element  in  a"^0,  otherwise  |x^|  -►  ® in  such  a way  that  -e^x^  converges  to  the 


minimum  element  in  R(A) . 

□ 

Proof.  There  exists  a unique  sequence  with  y^  c Ax^  such  that  (3.3)  holds.  For 

S4.ir.plicity  we  shall  denote  the  element  also  by  Ax^.  First  we  reduce  the  problem  to  the  case 

where  e i 0.  In  fact,  if  the  conclusion  holds  for  e = 0 it  also  holds  if  te  ) has  com- 
n n n 

pact  support.  Then,  approximating  {e^}  e by  a sequence  (e^)  with  a compact  support 
and  using  the  fact  that  the  resolvents  axe  contractions  we  have 


(3.4) 


X - X < € 

' n n — 


if  1 je.  - e.|  < E,  which  completes  the  reduction. 
j=0  ^ ^ 

Subtract  p ...  from  both  sides  of  (3.3)  to  get 
n(i) 


(3.5) 


(1  + X e )x  . - p ...  X„Ax  “ * - 

n n n+1  n(i)  n n+1  n n(i) 


Using  (3.1)  we  obtain 


" Vn>‘Vl  - Pn(i)>  * 'Vn  ' Vn(i)>Pn(i) 


(3.6) 


* ^n'^n  - ^n''Pn(i)  " *n  ” ‘'n(i)  ' 


where  AP„^)  st^^lds  for  the  element  satisfying  0„(i)Pn(i)  *Pn(i)  ^ 
monotone  (3.6)  yields 


(1  + X_9_)  |x, 


n^'l*n+l  ■ Pn(i)l  ‘ ^nl®n  ' ®n(i)  ' l^n(i)l  - l''n  *-0(1)  ' 


< - P„ 


and  iterating  this  from  n(l)  on  we  obtain 


l^n  - Pn(i)l  ' ^nd)!  * 


(i)  ■ ®j'  '^n(i)'  ■ 


Since  0^  is  nonincreasing  we  have 


-8- 


n(i+l)-l 

TT  (1  + >-0-) 

j=n(i)  ^ ^ 


n(i+l)-l 

.0,)"^  < IT  (1  + x.e  . 

^ ^ - j=n(i)  ^ 


But  (2.6)  and  (2.8)  imply  that  there  exists  a > 0 such  that  6 


n(i+l)-l 

i.  , ^ a and 


..  .......  „ n(i+l)  . j - 

3“n(i) 

n(i+l)-l 

hence  foi  some  6 < 1,  IT  (1  + A.0.)  < i.  For  the  second  term  in  (3.7)  we  obtain 

j=n(i)  ’ ^ - 


n(i+l)-l 


n(i+l)-l 


J I A,|0  -6  |-Oasi-»»by(2.8). 

3=n(i)  3 ’ - j=n(i)  ^ 


Hencfc»  for  n(i)  < n < n{i+l)  we  have 


and  in  {jarticular 


l"n  - Pn(i)l  - l’'n(i)  ' Pn(i)l"  ^(i)  IPn(i)l 


l’‘n(itl)  - Pn(i)l  i'*l’'n(i)  ' Pn(i)l  " "n(i)  IPn(i)l  ’ 


Since  A is  monotone  we  have 


^‘^n(i)  ■ ^’nCi+D*  - ^^n(i)  " *’n(i+l) 


0 t*'’n(i)  ■ *Pn(i+l)]  ^ 


^[®n(i)  ■ ®n(i  + l))  ^®n(i  + l)’iPn(i)l 


From  (2.6)-(2.8)  we  see  that  lim  ( ij  =0.  Hence  (3.9)  and  (3.10)  yield 

i-~>  \:n(i  + l)  / 


l’‘n(i+l)  ■ ^n(i+l)^  - '“'nd+D  " ^’nd)'  '^nd)  " ^nd+l)  ^ 

^ «l’‘nd)  - Pnd)l  " “nd)  l'’n(i)l  ' 


where  a ...  •=  e ...  + ^ 
n(i)  n(i)  0 


1 -►  0 as  i -*■  “>.  But  (3.10)  and  (3.11)  imply  that 


, , . I^ndtl)  ~ Pnd-H)  I , J^nd)  ~ ^nd)  ^ 

<'-“nd)'  nd) 


holds  for  a ...  ->0  and  6 < 1 and  therefore 
n(i) 


-9- 


Using  (3.8)  we  then  obtun 


lim  max 


- Pn(i)l 


i-K»  n(i)<n<(i+l)  ^ ^ ^n(i)^ 


If  A ^0  d then  by  Lenma  , ■*■  P<  where  p is  the  minimum  element  in  A ^0,  and 

by  (3.13).  we  also  have  lim  )x  - p)  = 0.  Assume  then  that  A ^0  = 0.  By  Lanma,  |p  I "*■  " 

n-H»  " 

and  "®jjPjj  '*  From  (3.13)  it  follows  immediately  that  l*jjl  "*■  ” n To  prove 

ex-*-  -a®,  oonsider,  for  n(i)  < n < n(i+l), 
n n — — 


0x  -0,.,p,., 

' n n n(i)^n(i)  ‘ 


'*n  - Pn(i)l 


I ® /i  \ * ® I 1 I 

' n(i)  n' ' n* 


®n(i)  * ®n(i)lPn(i)l  ^ * l^n(i)'  ®n(i)  ^ '^n(i)l 

The  first  term  on  the  right  in  (3.14)  tends  to  zero  as  i -»■  » by  (3.13),  and  in  the  second 
|Xnl  l®n(i)  ■ ®nl 

term  . . , stays  bounded  while  r 2 — , q as  !-►»>.  Since  0 ,.,p  -►  -a  , 

l + lPn(i)l  9^(i)  n(i)‘'n(i) 

we  finally  obtain  0 x -►  -a°  as  n 
n n 


Schemes  of  the  form  (3.3)  have  also  been  discussed  in  [7]. 

Assume  now  that  A is  defined  in  the  whole  space  and  is  continuous.  Following  the  idea 
in  (4]  we  write  the  explicit  scheme  (1.2)  as  an  implicit  scheme  (3.3)  with  errors: 

(3.15)  X + X (Ax  ^,  + 0 X ^,)  = x + e , 

n+1  n n+1  n n+1  ii  n 


e “ X (Ax  .,-Ax  + 0(x.,-x)) 

n n n+1  n n n+1  n 


Proposition  2.  If  {X  } and  {0  ) are  chosen  according  to  the  procedure  described  by  (2.4) 
«» 

and  (2.5),  then  \ |e^|  < <»,  and  {X  },  {8  ) are  acceptably  paired. 
n»0  " 


Proof.  (Jsing  (2.4)  we  have 


i 


T 


I |e  I = I A Jax  - Ax  + 0 (X  ^ - X )| 

n=0  " n=0  " n n n+1  n 

to  n-1 

1 I ? A ) . 

n=0  j=0  ^ 


But  (2.2)  and  (2.3)  imply  that 

® n-1 


I X *(  I A ) < 6(h  ,h  ) I A 5:  A ) 
n=0  " j=o  3 ° ° n=0  " j=0  ^ 


^ 5(h  »h  ) / i(i(s)ds  < “ , 

0 


which  proves  that  I | e | < <». 


n=0 


If  (2.5)  holds,  then  we  have 


n(i+l)-l 

“ + r„h_  > 0 , . , I A . ^ a 
j=n(i)  ^ 


0 0 — n(i) 


r , 

since  A^  £ h^  and  0^^^^  £ and  together  with  A these  imply  that  {A^}, 

{9n}  are  acceptably  paired.  Assume  therefore  that  for  some  n(i)  there  does  not  exist 
any  n such  that  (2.5)  holds,  i.e. 


(3.17) 


®n(i)  . ^ " • 

3=n(i)  ■' 


This  leads  to  a contradiction:  Consider  the  scheme  (3.3)  with  9 E 0 E 9 > 0 emd 

n n(i) 

• «0 

assume  that  1 A < » and  ^ |e  | < ».  One  proves  easily  that  x converges  to  some 
n=0  n=0  " 

*oo'  An  fact,  if  {e^}  hets  compact  support  then, for  large  enough  1**^  + Sx^|  is  nonin- 
creasing emd  therefore  for  some  c < » 


I I 


n-0 


X ^ - X 

n+1 


; 1 < C 7 A + |e  I , 
n'  — n n' 

n«0  n=0 


and  so  fx,,)  As  a Cauchy  sequence.  The  general  case  follows  using  the  same  approximation 
argument  as  in  the  proof  of  Proposition  1. 
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since  A is  continuous  there  is  an  h « {h^}  such  that 


A(x  - h(Ax  + 0x  ))  - Ax  - he (Ax  + ex  ) 


OO  flO 


1 J I 

^ j-0  ^ 


But  then  also 


1a(x  - h(Ax  + 6x  ))  - Ax  - he  (Ax  + Bx  )| 

' n n n n n n 

n-1 

1 -K  I 

j-0  ■’ 

for  large  enough  n and  therefore  ^ h,  contradicting  the  assumption  {X^}  e 

□ 

Theorem  1 follows  by  combining  Proposition  1 auid  Proposition  2. 


4. 


Proof  of  Theorem  2. 


In  13)  Bruck  proves  a convergence  result  for  general  maximal  monotone  operators  using 

(1.2),  under  the  assumption  that  A ^0  y Cl,  {x  ) is  defined,  and  both  (x  ),  (y  ),  y f Ax 

n n n n n 

are  bounded.  Ho  ttien  applies  the  result  to  prove  the  existence  of  a convergent  iteration 
scliemc  for  operators  which  are  bounded  in  a ball  centered  by  a p c A ^0.  The  scheme  is  de- 
fined, however,  only  after  we  have  a priori  knowledge  on  the  location  of  A ^0  and  the 
boundedness  of  A.  Theorem  2 is  a different  version  of  Bruck 's  result  in  the  sense  that  it 
only  assumes  a qualitative  growth  condition  to  be  satisfied;  one  does  not  have  to  know  that 
solutions  exist  and  one  can  start  from  any  initial  vector. 

We  could  prove  the  part  of  Theorem  2 where  A ^0  y (J  by  showing  that  (x  ) is  bounded 

n 

etnd  then  using  the  result  of  Bruck  [3].  However,  when  showing  that  (x  ) is  bounded  we 

n 

essentially  shall  get  the  convergence  as  well,  and  therefore  we  give  here  the  complete  proof. 

Let  again  p be  defined  by  9 p + Ap  y 0.  We  also  denote  by  Ap  the  element  w 
*^n  ' n n “^n  ' “^n  n 

in  the  set  Ap  which  satisfies  9 p + w =0,  and,  similarly,  we  denote  by  Ax  the 
n n n n n 

vector  (x  - X ) /X  - 9 x . Subtracting  p ,,,  from  both  sides  of  (1.2)  yields 
n n+1  n n n n(i) 


(4.1) 


X , - P ,,,  = X - P - X (Ax  + 9 x ) 
n+1  n(i)  n n(i)  n n n n 


.Squaring  both  sides  of  (4.1)  eind  rearranging  yields 

1 2 I 1 2 


*n+l  ^n(i) ' 


X - P ,,vl  + 2X  (9  - 9 ) (x  , X - p ,.,) 

n “^nd)'  n n(i)  n n n n(i) 


(4.2) 


- 2X  (Ax  + 9 ,,.x  , X - P ,,,) 
n n n(i)  n n n(i)' 


+ X^  I Ax  + 9 X I ^ . 

n ' n n n ' 

Since  A is  monotone  and  9 ,,,p  ,, , + Ap  ,,,  « 0,  we  have  (Ax  + 9 ,,.x  ,x  - p ,,.) 

n(i)'^n(i)  *^n(i;  n n(i)  n n *^n(i) 

> 9 ,,,  lx  - p ,,,  I . Using  (2.1)  the  last  term  on  the  right  of  (4.2)  can  be  bounded  in  the 
— n (i)  ' n ^^nd)  ' 


form 


I'^n  * Vnl^  - Pn(i)l^  ^ 'Pn(i)l^‘  • 


For  the  second  term  we  write 


<’‘n'  “n  - Pn(i)’l  ^ l*n  ' ^nd)'"  " 2 ■’‘n  ' ^nd)'"  ^ ^ IPnd)'" 
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Substituting  these  into  (4.2)  yields 


5 


"I 


IVx-Pn(i)l  i - ®n,n(i)>l’‘n  - Pn(l)l  ^ "n,n  (i) " l^nd)  ' ' 

where 

B • 2X  ,e  ,,,  - 2(1  + V)x  le  ...  - 0„(  - c.x^  , 

n,n(l)  n-1  n(i)  n'  n(i)  n'  In 

and 

Vn(i)  l®na)  - ®nl  "Vn  ’ 

Since  {X  } « , 2md  the  sequences  are  acceptably  paired  we  have  for  large  enough  n(i)  and 

n 

some  Oj^  > 0,  Oj  < " that 


(4.4) 


n(i+l)-l  n 

I B.  i a and  I 6 . 1 -a, 

j-n(i)  ' j-n(i)  =* 


for  n(i)  < n < n(i+l),  and  if  we  denote 


n(i+l)-l 

jj(i)  ‘ 


then  lim  c 0. 

, n (i) 

X.  >«» 

Iterating  (4.3)  from  n(i)  on  yields  together  with  (4.4)  that  for  n(l)  large  enough 


we  have 

(4.5) 

l’‘n(i+l)  ■ '’n(i) 

1 - '’l*n(i)  ■ '’n(i)l  * ^n(i) 

for  some 

6 < If  and  for  some 

D < "»  and  n(i)  i n £ n(l*l) , 

(4.6) 

l^n  - Pn(i)l^  i 

''l*n(i)  - Pn(i)l^  * "n(i)'^  ^ 

I*>n(i)l'‘  • 

Now  one  completes  the  proof  as  in  the  proof  of  Proposition  1 using  (4.5)  and  (4.6)  in  place 
of  (3.9)  and  (3.8). 

□ 

To  the  end  we  state  a simple  result  for  operators  of  the  form  bl  + B. 
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Proposition  3.  Let  B be  maximal  monotone,  D(B)  * H and  assume  that  B satisfies  the 

2 1 

growth  condition  (2.1).  Assume  also  that  b > 0 and  {X  } f.  S.  \i.  . If  (x  } satisfies 
^ n n 

(1.5),  then  it  converges  to  the  unique  solution  of  bx  + Bx  0. 

n 

The  proof  is  easier  than  that  of  Theorem  2 and  is  left  to  the  reader.  Related  results  arc 
proved  in  (2J,  (6). 


I 
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